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(57) Abstract: A visual indicator such as a cursor (3) is moved between two or more screens (1. 2) of a multi-layered display 
Q system, via an input device. The input device can be a touch screen, where varying the degree of pressure applied to the touch screen 

determines on which screen the cursor is displayed. The plurality of screens (1, 2) may comprise liquid crystal displays, and provide 
^ a three dimensional depth effect. 
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CONTROL OF DEPTH MOVEMENT BETWEEN SCREENS OF MULTILEVEL 
DISPLAY 

Technical FIELD 

This invention relates to a visual display system. 
BACKGROUND ART 

Particularly, the present invention relates to a visual display system including single 
level screens placed physically apart to form a multi-level screen. 

Such screens are described in PCT Application Nos. PCT,l^Z98/00098 and 
PCT/NZ99/00Q2L 

These devices are created by combining layers of selectively transparent screens. 
Each screen is capable of showing an image, hi preferred embocoments the screen 
I^ers are liquid crystal display. Preferably the screens are aligned parallel to each 
other with apre-set distance between them. 

With this device images displayed on the screen furthest from view (background 
screen) will appear at some distance behind the images disfplayed onthe screoi closer 
to tiie viewer (foreground screen). The transparent portions in the foreground screen 
will allow viewers to see images displayed on the background screen. 

This arrangement utilising multiple screens allows images to be presented at multiple 
levels giving the viewer true depth witiiout use of glass or lens. 

Up until now, software has been written to create visual sequences on the multi-level 
screens. These sequences have been mainly passive, mainly for viewmg rather than 
for interaction. 

While the visual effect of these sequences is spectacular, it will be desirable if 
potential uses of a multi-level screen display could be explored further. 
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It is an object of the present invention to address this problem^ or at least to provide 
the public with a useful choice. 

Aspects of the present invention will now be described by way of example only with 
reference to the following desoiption. 

Disclosure of lisfVENnoN 

According to one aspect of the present invention there is provided a visual display 
Sfy^m including 

at least two single level screens spaced physically apart to form a multi-level screen, 

wherein each single level screen has a two-dimensional plane, 

a visual indicator, 

an input device, 

a user selectable ii9)ut, 

the visual display system being characterised in that 

the user can use the user selectable input to move the visual indicator via the input 
device out of the two-dimensional plane of a particular screen and on to another 
screen. 

According to ano&er aspect of the present invention there is provided a method of 
using a visual display system which has at least two multi-level screens spaced 
physically apart, 

wherdn each screen has a two-dimensional plane, 
the visual display system also including 

2 , 
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a visual indicator, 

an input device, 

a user selectable input, 

tilie mediod characterised by flie step of 

the uses: using the selectable input to move the visual indicator out of the two- 
dimensional plane of aparticuiar screen and on to anoflier screen. 

In one aspect of the present invention there is provided media omlaining instructions 
for the operation of visual display system as desoibed 

In preferred embodiments of the present invention the multi-level scre^ are similar 
to that described in PCT AppKcation Nos. PCT/NZ98/00098 and PCT/NZ99/00021, 
although this should not be seen as limiting. 

The term two-dimensional plane refers to the effective viewing plane on a particular 
screen, similar to Hbat seen on a normal display screen. 

The visual mdicator m^ be any type of indicator, for example a cursor, image, icon 
or screen image. It is envisaged that the visual indicator is something which can 
move in response to the user of the system via some input mechanism. 

The input device may be any suitable input device, for example a mouse, tablet data 
glove, keyboard, touch screen, joystick, trackball, pen, stylus, touch pad, voice and so 
forth. 

The user selectable input is preferably an input the user can make to effect the 
operation of software running the display device via the input device. 

For sample, if the input device is a mouse, then tiie user selectable input may be a 
mouse buttoiL If the input device is a joystick, then the user selectable input may be 

3 
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the trigger. If flie user input is a keyboard, then the user selectable input may be 
arrow keys. And so forth. 

We envisage that the preset invention could be used extensively by those in the 
graphics industry. Therefore one embodiment in ihe present invention is envisaged 
that by having tiie input device as a pen or stylus, the present invention could be 
utilised in tibiese industries to its fullest. 

In some embodiments, the user selectable input may actually be a software button on 
a touch screen that may be independent of the input device. This allows standard 
input devices and drivers to be used without modification. 

In some embodiments of the present invention, the input device shall be a mouse and 
the user selectable input is a mouse button. The mouse button may be an existing 
button on the mouse, or in some embodiments may be a dedicated button for use with 
tibe presmt invention. 

This should not be seen as limiting. 

In preferred embodiments of the present invention, the input device is a finger of the 
useroras^us. The user sdectableiiiput is actually tiie pressure spplied by the user 
to a touch screen. 

The touch screen may be any type of screen ^^ch allows direct user interaction with 
the screen to affect the display. For example, the touch screen may be cqiacative, 
optical or acoustic, or any otiier technology which achieves the desired us^ inter&ce. 

The visual indicator shall now be referred to as a cursor, although this should not be 
seen as limiting. 

The user can lightly press tfaek finger on a touch screen to move a cursor around the 
display touch screen as can be achieved wifli usual software. However, with one 
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embodiment of the present invention, the user can apply greater pressure on the touch 
screen to cause the visual indicator to move £rom one so^en to another screen. 

While in some embodiments tiie means by ^^ch the user can move the cursor fiom 
one screen to the other may not be pressure (for example, a double tap), this is tiie 
preferred embodiment 

In some embodiments, the actual amount of pressure required to move &e cursor 
fiom one screen to the other may be variable and chosen by the user. For example, 
there may be provided a scroll bar which enables the user to increase or decrease the 
effective pressure required to move the cursor. Ideally, the amount of pressure 
should be such that a light pressure on the screen enables a user to easily move the 
cursor on one screen without worrying about slight variations in pressure causing the 
cursor to go up to the other screen. However, the pressure required should not be so 
strong as it is uncomfortable for the user or the physical conjBguration of the screen. 

hi a preferred CTibodimen^ flie touch pressure data consists of a number between 0 
and 255 which is stored in an accessible register and constantly updated by touch 
screen drivers. The relationship between the number and the actual physical pressure 
in Pascals is part of software for a conmiercial touch screen driver. However as an 
^cample, a light touch can give a reading of around 30-50 units while a firmer one 
around 180-220. A likely threshold to cause die cursor to jump screens could be in 
the order of 175 or so units. This can correspond to a deliberate but not finger 
destroying push to make it hqjpen. 

In one embodiment there may be included an auto calibration system. A persons first 
touch can be measured and used as a basis or system reference for what the persons 
normal touch pressure was. For die threshold pressure to jump screens can then be 
determined as a set percentage higher than this. 

An alternate application of the present invention can include a '^g of light^ around 
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a screen icon. This can make the icon glow more as you pushed harder. For 
example, there could be four ranges of touch pressure which resulted in four levels of 
light intensity being displayed. At a certain intensity then the cursor can jump fiom 
once scseea to another. 

Suitable software to implement the above embodiment is Macromedia TM Director. 

Depending on tibie ravironmrat, greater or lesser pressures may be required to move 
tiie cursor fiom one screen to another. 

In a preferred embodiment the software controlling the cursor position is 
suppl^ental to usual toudi screen driv^ software. 

In a pre&ned embodiment Ifae present invention the touch screm driver software 
used is ELO Touchsfystems Touchscreen Drivers Distribution >K^n9xRc8jzip. This 
contains touch screen drivers 03.00.00 and has control panel MonMouse.cpI version 
3.08RC8. 

Tlierefore a program can run as usual with standard mouse drive commands but the 
cursor position between screens can change as a consequence of the interaction of the 
supplemmtal program responding to the additional pressure fiom the user. 

This ability enables the user to actually interact with different screens and work on 
separate screens at the touch of a finger and can readily interact with "^chever 
screen has been selected. The advantages ofthis feature are self ^parent 

hi some embodiments, the movement fiom the two-dimensional plane of one sa:een 
to anoth^ screen may be discrete and it may appear that the visual indicator merely 
jumps fit)m one screen to tte other and be at the same x-y coordinate with fiie only 
change being in the z axis. 

In other anbodunents, there may be more of a linear movement perceived as a 

6 
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consequence of the movement fiom one screen to the other. 

For example, the present invention may be used in conjunction with a drawing 
package. The person drawing may start drawing on the front screen of the visual 
device using fheir finger as an input device. 

The person then may wish to take advantage of the three dimensional quality allowed 
by the present invention and effectively draw in the z axis (the x and y axis having 
aheaffy been drawn in on the two-dimensional screen). This niay be achieved by th^ 
user pressing on tiie screen and dragging the cursor effectively so it spears to pass 
fiom one screen to the other screen with an image (say a line) appearing to provide a 
visual bridge betwe^ the firont screen and another screen or screens in the 
background 

hi otfa^ embodiments of tibe present invention this ability may be used with particular 
total screen ima^s. For example, the present invmtion may be used with an 
interactive game which gives ibe impression Hast the user is moving deep within a 
scene. For example, the user may be flying a craft in the game and as Ae user moves 
forward in the game, the images may pass fix>m the background screen or screens to 
the for^round screen ^ving the illu^on of fidl movemrat In this embodiment the 
visual indicator inay be the iiiiages and the input device a joy-stick. 

Aspects of the present invention will now be described with reference to the 
following drawings which are given by way of example only. 

BRIEF Description OF DRAWINGS 

Fur&a: aspects of the present invention will become apparent fiom tiie following 
description which is given by way of example only and with reference to tiie 
accompanying drawings in which: 



Figure 1 illustrates one embodiment of the present invention, and 
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Figure 2 iUmfmtes a second embodiment of the present invention^ 
Figure 3 illustrates a third embodiment of the present inventioiL 
Best Modes for carrying out tbe Invention 

Figures la and lb illustrate a stylised version of one embodiment of the preset 
invention at work. These figures have foreground scre^ 1 and background screens 

It should be appreciated that fiie reference to just two screens is by way of example 
only and the present invention may work in relation to multiple numbers of screens. 

Figure la shows the positioning of the visual indicator 3 in the form of a cursor arrow 
on the fix>nt foreground screen L 

In this embodiment of the present invention a simple push of a finger or stylus causes 
the cursor 3 to appear in exactly the same x-y coordinates as on the foreground screen 
one, but, positioned on the background screen 2. 

Ihus in this embodiment, the user does a direct transpose in the z-axis between 
scre^is. 

Figure 2 likewise has a foreground screen 1 and a background screen 2. InFigure2a, 
a triangle 4 has been drawn on the x-y two-dimensional plane of the for^round 
screen L 

Tn Figure 2b, to give the triaagle 4 depth, the user has selected and dragged the image 
in the X y direction to give not only tihe image of a triangle S on the back^und 
screen 2, but also a plane in the z axis 6 for finding a solid-lookmg represmtation. 
As the screens are physically quite separate, the illusion of the solid wall 6 is 
accomplished by sophisticated software shading techniques. 
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Figure 3 again has a foreground screen 1 and background screen 2. 

This embodiment of the present invention can be used for moving through three- 
dimensional landscapes. For example, in Figure 3a, thore is pictured a floiver 7 on 
the foreground screen, tree 8 along with a cloud 9 are positioned on the background 
screen 2. 

The user ma^ then use their finger or stylus to effectively move throug|i the scene 
visuaUy. This causes the flower depicted in Figure 3a to disqypear fit>m the 
foreground screen as shown in Figure 3b. This also causes the tree 8 to move fix>m 
the background screen 2 to the foreground screen L The cloud 9 being in die &r 
background stays on die background screen 2. 

Thus it can be seen that the present invention allows considerable amount of 
interaction between the user and the screeus. 

Aspects of the present invention have been described by way of example only and it 
should be predated that modifications and additions may be made thereto without 
departing fixmi the scope of the appended claims. 
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WECXAIM : 

1 . A visual display system including 

at least two single level sa:eens spaced physically apart, to fonn a multi level 
screen 

vdierdn each single level screen has a two-dimensional plane, 

a visual indicator, 

an iiqiut device, 

a user selectable input, 

the visual display system being characterised in that, 

the user can use the user selectable ixxput to move Ifae visual indicator via the 
input device out of the two-dimensional plane of a particular soera and onto 
another screen. 

2. A visual display system as claimed in claim 1 vMdk is based on LCD 
technology. 

3. A visual display system as claimed in either claim 1 or claim 2 herein the 
visual indicator moves in resfponse to the user of the system by a input 
mechanism. 

4. A visual display i^stem as claimed in any one of claims 1 to 3 wherein the 
visual indicator is a cursor. 

5. A visual display system as claimed in any one of claims 1 to 4 wherein the 
input device is any one of the group mcluding a mouse, tablet, data glove, 
k^board, touch screen, joystidc, trackball, pen, stylus, touch pad or voice. 

10 
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6. A visual display as claimed in any one of claims 1 to S herein the input 
device is a toudi screen. 

7. A visual display system as claimed in any one of claims 1 to 6 wherein the 
user selectable input is the pressure applied to a touch screen. 

8. A visual display as claimed in claim 7 wherein the amount of pressure 
required to move tiie visual indicator fiom one scteca to the other is variable 
and chosen by Ifae user. 

9. A visual disph^ as claimed in any one of claims 1 to 8 i^dietein the software 
controlling the visual indicator position is si^>plemental to usual touch screen 
driver software. 

10. A visual display as claimed in any one of claims 1 to 9 i^erein the movement 

of the visual indicator &om one screen to the other is at the same XY co- 
ordinate with only a change shown in the Z axis. 

11. A visual display as claimed in any one of claims 1 to 9 wherein the movement 
of the visual indicator is perceived as linear between one screen and the other. 

12. A method of using a visual display system which has at least two multi level 
screens spaced physically apart, 

wherein each screen has a two dimensioiial plane, 

the visual display system also including 

a visual indicator, 

an input device, 

a user selectable input. 
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this method characterised by the step of 

a) the user using the selectable input to move the visual indicator out of 
the two-dunensional plane of a particular screen and onto another 
screeiL 

13. A noiedia containing instructions for &e operation of a visual dii^lay system as 
claimed in any one of claims 1 to 1 1. 

14. A visual display system substantially as herein described ^tfa reference to 
and as illustrated 1^ the accompanying dravdngs. 

15. A meQiod substantially as herdn described with reference to and as illustrated 
by the accompanying drawings. 



12 



M^O 02/084637 



1/3 



PCT/NZ02/00059 




SUBSTITUTE SHEET (RULE 26) 



WO02/084«37 



2/3 



PCT/NZ02/00059 




SUBSTITUTE SHEET (RULE 26) 



wo 02/084537 



3/3 



PCT/NZ02/00059 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



PCT/NZ02/00059 



CLASSmCAIION OF SUBJECT MATTER 



Int a G09G 5/08, G06F 3/033, G02B 21172, 

According to International Patent Qassificatiaii (IPQ or to both national dassification and IPC 



FIELDS SEARCEDED 



Mmimom docmnentatioa seaidied (dassificatioa system followed by rlawrificntion symbols) 



Docmneotation searched otber ttian TniniTmim docmnentation to the extent that sudi documents are included in the fields searched 



Electronic data base consulted during the mteraatioDal search (name of database and, vfbm practicable, seardi terms used) 

DWPI, JAPIO ^th Keywords: multilevel, multilayer, 3d, three dinoens, depth, G02B 27/22; scIea^ cursor, icoo, 

pointer, icon, visual indicaton touch, pressure sensitive^ touchscreeti, touchpad; press, 
push, fiMce; var, difier, tfareshold, hard, degree 



DOCDBfBNTS CONSDDERKD TO BS RELEVANT 



Citation of document, with indicatton, "niieie qspcopri^ 



Relevant to 
claim No. 



WO 01/15132 A (DEEP VIDEO IMAGING LIMITED) 1 March 2001 
Whole document 



WO 01/09664 A (DEEP VIDEO IMAGING LIMITED) 8 February 2001 
Page 9, Figure 1 



JP 10-198507 A (KOMOTA KK) 31 July 1998 

(Abstract and translatian fiom wwwl .ip(Ljpo.go jp/PAl/cgji-bin/PAlINDEX) 
10 



1-15 



1-10, 12-15 



1,7-8 



Furflier documents are listed in the ccftrfmiiation of Box C 



X See patODt family annex 



* ^lecial catpgpiies of dted documents: 
"A" docnmait defining the general state of the art 
^ndiich is not considered to be of particular 
relevance 

earlier at^lication or patent but publi^ied on or 
after the intematianal filing date 

i*L" document may throw doubts on priority 
clami(s) or which is dted to establish the 
publif^on date of another dtation or other 
special reasfm (as specified) 

"O" document referring to anoral disdosoie, use, 

exhibition or other means 
"P" document published prior to the international 

filing date but later than the priority date claiined 



TP later document published aiter the intematimial filmg date qk priority date 

andixst in confiict with the application but dted to understand the 

prmciple or tiieoiy underlying the invention 
*^ document of particular relevance; the claimed invention cannot be 

considered novel or cannot b& consid«red to invdve an inventive step 

vAissi the document is taken alone 
^ document ofparticukrrdevanc^ the claimed invention cannot be 

considered to involve an inventive step when the document is combined 

with one or more other such documents, such oooahinatian being obvious 

to a person skilled in the art 

document member offhe same patent fionily 



Date of &e actual completion of the international search 
20 June 2002 



Date of mailing of fiie intenoaticnal search rq>ort 



28 JUN2D02 



Name and mailing address of the ISA/AU 

AUSTRALIAN PATBNI OFFICE 
FO BOX 200. WODEN ACT 2606. AUSIKAUA 
E-mail address: pct@ipaDstralia.gov.aa 
Facsimile No. (02)62853929 



Antfaoarizcd officer 

MICHAEL HALL 
Telephone No : (02) 6283 2474 



.Fonn PCT/ISAy2lO (second sheet) (July 1998) 



INTERNATIONAL SEARCH REPORT 



Intecnatianal supplication No. 
PCT/NZ02/00059 



C(Caiitiimalioii% 



DOCUMENTS CONSIDERED TO BE RELEVANT 



CatBgDiy* 



Cttation of document with indicatioii, where appropriate^ of thezelevant passages 



Relevant to 
dlajniNo. 



us S241308 A (YOUNG) 31 August 1993 
Cohiiniis3,7 



Deiwent Abstract Accession No. 89-212235/29, Classes TOl, T04, RD 302089 A 

(ANONYMOUS) 10 Jfune 1989. 

Abstract 



1,7-8 



1.7-8 



Foim FCT/ISA/210 (contimwtion of Box C) (Jnly 1998) 



» 








INTERNATIONAL SEARCH REPORT 


Inteisationa] application Na 




iDfonnation on patent fenuly mcmbecs 


PCT/NZ02/00059 



Tim Annex lists the known "A" publication level patent &mi]y mend^ers relating to the patent documents dted in the 
above-mOTtioned intemationai search report The Australian Patent Office is in no way liable for these particulars vihkh 
are merely given for the purpose of information. 



Fatnit Docmnent Cited in 
Search R^it 






FBtcntFamify Member 




WO 01/15132 


EP 


1212745 






-WO 01/09664 


AU 


63265/00 


EP 1204894 




IP 10-198507 


NONE 








US 5241308 


NONE 






END OF ANNEX 



Fonn FCT/ISA/ZIO (citatioii fianily annex) (July 1998) 



